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channel-down buttons on the remote control device. An intelligent agent passively filters selected web pages for a user to explore based on 
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DISPLAYING INTERNET CONTENT AND TELEVISION PROGRAMMING 

5 

The present invention relates generally to a 
client and server system for presenting multimedia 
information and, more particularly, to an integrated 
internet on-demand system for television. 
10 The internet is a collection of networks, 

including those maintained by commercial backbone providers 
such as MCI, PSINet, UUNET, and Sprint. The term "internet" 
applies to this entire set of interconnecting networks. 
Domain names, such as uspto.gov, are unique internet server 
15 addresses which function as the cyberspace addresses for 
organizations connected to the internet. 

Interest in the internet has been increasing 
recently, especially in regard to e-mail and what has become 
known as the World Wide Web, which allows information on the 
20 internet to be presented through a graphical interface. The 
World Wide Web is a major client-server system, with 
millions of users, and is essentially a vast collection of 
interconnected documents . 

Typically, on the internet, a larger computer is 
25 a server and a smaller computer is a client. A client can 
be a personal computer which is associated with the user. 
The client computer is connected to the internet via a modem 
connection, typically to a server at a point-of -presence 
(POP), the location of an access point to the internet. A 
30 client can use any of the servers, and often uses a series 
of them. The primary purpose of a server is to deliver a 
document on request to a client. The document may be text, 
an image file, or other type of file. The document is 
identified by a name called a Uniform Resource Locator 
35 ("URL") which typically includes the domain name of an 

organization. If the server is storing that particular URL, 
then the server delivers the document at that URL to the 
client in response. 



BNSDOCID: <WO 98561 88A2_I_> 



SUBSTITUTE SHEET (RULE 26) 



wo 98/56188 



PCT/IB98/00895 



-2- 



Browsing software (i.e., web browsers) allow 
client users to request and display text and graphics, 
typically from a " Hyper Text Markup Language ("html") 
document or web page identified by a URL on a web site 
server. When accessing web pages over the internet; a 
client user may reference an html document containing 
hypertext links to other documents, which may have URL 
addresses to different servers. When a link is selected, 
the browser is expected to fetch the new document and 
display it in place of the current one. In this manner, 
information from different internet servers can be linked 
together through documents containing such links . These 
links may be organized according to topics so that the links 
grouped under a particular topic relate to addresses for web 
pages which deal with related subject matter. For example, 
the U.S. House of Representatives' web server hosts html 
documents at URL address http://law.house.gov which contain 
links to a variety of other web pages generally relating to 
le-j?.! i <5'=:np.=! . tncxuamg pacenc xaw. nuw=v=i., J^^^.^-. l-^.^Iv- 
are presented to the user in a static manner, often with 
little guiding information. 

Requesting web pages from servers using a client 
browser is commonly referred to colloquially as surfing the 
web. Although the use of animation, as well as audio and 
5 video, is becoming more common, the majority of web sites 
generally only present static graphical images. Even with 
data compression techniques, graphical files are notoriously 
large and slow to download given the limited bandwidth 
available over existing telephone modem connections. A web 
0 page having a large number of graphical images can take 
several minutes to retrieve. Audio' and video files are 
typically very large, and can take even longer to completely 
download. This can result in long and frequent delays in 
retrieving and using such files. 
5 However, the typical television viewer is 

accustomed to a near immediate response when selecting a 
channel or television station to watch. Although off-line 
browsing allows a client user to view pages already stored 
in cache memory from previously visited web sites, these 



documents are often not meaningfully organized, such as by 
topical subject matter, for easy assimilation by the client 
user. Nor do these cached pages necessarily represent the 
most recent version of the pages available from the web site 
5 of interest. 

Along with the. increasing interest in the internet 
and the world wide web, appliances or set-top boxes similar 
to cable TV boxes have been developed in an attempt to allow 
access to the internet through the traditional television 
10 set. However, such attempts suffer from delays in accessing 
the graphics of the web, and the lack of experience in the 
mass -market with regard to the internet, especially in 
regard to finding and accessing relevant web pages of 
interest. Mass-market consumers are typically accustomed to 
15 having information broadcasted or delivered to them with 
minimal effort or delay. 

The practice or technology of having 'information 
brought to a client user by an agent is sometimes referred 
to as push. Pushed information appears to have been 
20 initiated by the server rather than by the client or the. 
user. However, in current systems, the information pushed 
from a server to a user often comes as the result of a 
programmed request from the client in the user's computer. 
Information pushers often require that the client download 
25 a program which often determines the useful data desired by 
the user and then occasionally initiates requests for 
information from the server. However, users may find such 
questionnaires to be burdensome, and may not completely and 
accurately complete the questionnaire. 

Hence, there has been a long existing need for a 
system which is capable of navigating the internet 
efficiently so as to provide text, images, sound, and 
video on-demand in a simple, intuitive manner akin to 
traditional television programming for mass -market 
consumers. Illustrative embodiments of the invention 
described herein seek to fulfil these needs. 



30 
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An embodiment of the present invention provides 
^ an internet on-demand system for television presenting 

internet content and traditional television 
programming as part of a single coherent interface. 

The system selectively displays internet content 
and television programming. The system comprises a client 

10 including a display. The system further comprises means for 

selecting between channels separately representing 
individual television content and individual internet 
content. When an individual television content channel or 
an individual internet content channel is selected, the 

15 client presents the content associated with the selected 
channel on the display. Means for displaying an internet 
gateway interface selectively scrolls through links to 
selected web pages organized according to templates 

r'or-r-tfa cp/^nH xnrr h p^^^ nnr^f- (=>T^f- d t c:p1 *=iypd on i n ^ #=» rri r. 

20 content channels. The server includes means for 

establishing a data connection with the client and 
downloading data along the data connection to the client. 

An embodiment of the present invention provides 

a user interface for efficiently navigating among 
25 . , ^ . , . 

different information sources m a simple, intuitive 

manner - 

Another embodiment of the present invention 
displays an internet gateway interface which actively 
3Q scrolls through and highlights links to selected web 

pages . 

A further embodiment of the present invention 
presents an internet gateway, web pages, and 
traditional television programming as part of a single 
coherent interface. 

Still another embodiment of the present invention 
provides a dynamic interface organized into categories 
of information in a coordinated and coherent manner. 



One embodiment of the present invention' displays 
a rotary menu on the screen to present both internet 
links and traditional television programming as 
channels for selection by the user. 
5 Yet another embodiment of the present invention 

uses an intelligent agent to passively filter selected 
web sites or content for a user to explore based on 
the past pattern of usage of the client by the user. 

Another embodiment of the present invention 

10 categorizes the selected web content into topics 

contained in a template based on attributes 
identifying the subject of the web pages, and present 
links to those web pages in a graphical interface 
based on the template to the' user. 

15 In another embodiment of the present invention 

the server queries the client regarding its available 
data stream connections in order to determine the most 
efficient delivery of different types of data through 
all of the available connections . 

20 An additional embodiment of the invention 

coordinates the data stream to the client across 
different' data connections in^ order to maximize the 
available bandwidth capacities to provide a more 
coordinated and faster internet experience when 

25 presenting text, graphics, video and audio information 

from a web page . 

Another embodiment of the invention uses both 
background delivery ^ of internet content, and 
coordinated data streaming across different data 

30 connections. 

These and other aspects of the invention are 
specified in the claims to which attention is invited. 

A better understanding of the invention will 
become apparent from the following illustrative 

35 description, taken in conjunction with the 

accompanying drawings, in which: 
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FIG. 1 is a block diagram illustrating a client - 
server system in accordance with the present invention; 
5 FIG. 2 is a block diagram illustrating the client 

of the client-server system in accordance with the present 
invention; 

FIG. 3 illustrates templates for categorizing web 
pages or links to web pages in accordance with the present 
0 invention; 

FIG. 4 illustrates documents being sorted into 
topics from the templates in accordance with the claimed 
invention ; 

FIG. 5 illustrates an active frame for a graphical 
5 user interface in accordance with the present invention; 

FIG. 6 is a flow chart illustrating the active 
frame for a graphical user interface in accordance with the 

FIG. 7 illustrates anotner embodiment of che 
0 active frame for a graphical user interface in accordance 

with the present invention; 

FIG. 8 illustrates a rotary menu wheel for a 
graphical user interface in accordance with the present 
invention; 

5 FIG, 9 is a flow chart illustrating the rotary 

menu wheel for a graphical user interface in accordance with 
the present invention; 

FIG. 10 is a flow chart illustrating the passive 
filtering for the client - server system in accordance with 
0 the present invention; 

FIG. 11 is a block diagram illustrating the 
multiple data streams for the client-server system in 
accordance with the present invention; and 

FIG. 12 is a flow chart illustrating the 
5 processing of multiple data streams by the client in 
accordance with the present invention. 



Referring now to the drawings, and in particular 
to FIGURE 1, there is shown a client-server system for 
presenting multimedia internet content and broadcast data 
and television programming on a television screen. The 
client 10 includes a set-top box 12 which is connected to or 
integrated within a television appliance 14. The set-top 
box 12 provides connections to video and computer data 
sources which are processed and displayed on the screen of 
the television appliance 14 . The television appliance can 
include a cathode ray tube ("CRT"), liquid crystal display 
("LCD"), or other device capable of presenting a video 
image. The client is preferably connected to the server 16 
by a telephone modem 18 . 

The client further includes a processor 20 capable 
of performing multimedia tasks, programming for internet web 
browsing and controlling multimedia tasks, a digital data 
storage medium 22 such as a hard drive, digital video disk 
("DVD") or digital video tape ("DVT"), and a remote control 
device 24 to allow the user convenient control of both 
internet and television functions through the set-top box. 
The remote control device 24 preferably includes numeric ' 
keys, channel-up (forward) and channel-down (back) buttons 
for selecting channels, directional controls for controlling 
movement, such as a cursor or menu selector, on the 
television screen, a button for activating a link or 
command, and dedicated keys for jumping to a home page or 
other specialized function. Alphanumeric or other text may 
be input using the remote control device or a separate 
keyboard. A method and apparatus for entering text using an 
input device having a small number of keys is disclosed in 
U.S. Patent No. 5,543,818 ("Scott"), and is hereby 
incorporated by reference. 

The video connections to the client 10 can include 
cable 17 and digital broadcasting satellite ("DBS") 19. The 
video connections may be made to peripherals such as a VCR 
which would be connected to the set -top box. The computer 
data connections to the client can include telephone modems 
and ISDN connections, as well as digital satellite data 
services, and cable modems over the video connections to the 
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client. It should be noted that the client can utilize 
several different types of data connections simultaneously. 
Computer data information may be multiplexed or otherwise' 
embedded in a video signal source. A television receiver 
with a decoder for decoding coded data from a video 'signal 
is disclosed in U.S. Patent No. 5,512,954 ( "Shintani" ) , 
which is hereby incorporated by reference. Both television 
and computer data can be provided to the client over the 
same digital satellite connection. For example, the client 
can utilize both a telephone modem and a digital satellite 
service, where the satellite service delivers to the client 
both traditional television programming, as well as internet 
content during the blanking signal of the television 
programming . 

The processor 20 of the client is a multimedia 
processor which preferably includes a very long instruction 
word (VLIW) architecture. A suitable processor is known by 
the tradename ^^TM-1" which is manufactured by Philips 
seuniconauc uui to - j. j-*-i<;-v-..^<-* i. . 

0 California. A block diagram of the processor 20 of the 
client 10 is illustrated in FIG. 2 by way of example. The 
processor includes a CPU 3 0 having an instruction cache 32, 
a data cache 34, and VLIW architecture which can run a real- 
time operating system (RTOS) kernel. To save bandwidth and 

5 storage space, the VLIW instructions can be compressed until 
needed. The processor includes an application library which 
can provide routines to establish a data connection with a 
server over a modem, enable web browsing, retrieve e-mail, 
encode and decode video data compressed using the MPEGl 

0 standard, and decode MPEG2 files. 

Synchronous DRAM (SDRAM) 36 is available through 
the memory interface 38 and data 43 containing a boot 
program for the processor can be connected to the processor 
through a PCI interface 44 to enable standalone operation of 

5 the processor. 

A number of dedicated coprocessors are connected 
to the CPU through the data bus. An image coprocessor 46 is 
available to copy images from the SDRAM to a video frame 
buffer and perform scaling and color space conversions. A 



transfer rate of 50 megapixels per second (Mpix/Sec.) can be 
maintained by the image coprocessor. A variable-length 
decoder (VLD) coprocessor 48 is available to assist in 
decompressing MPEGl and MPEG2 data streams . 
5 Direct memory access (DMA) driven multimedia 

■input/output (I/O) units which operate independently to 
process data are connected to the CPU 30. The video input 
unit 52, video output unit 54, audio input unit 56, and 
audio output unit 58 are DMA-driven I/O units. The video 

10 input unit 52 can accept video data from a video decoder 60 
which converts a composite Y/C video signal into YUV 4:2:2 
digital video data. The video output unit can provide data 
in YUV 4:2:2 video output format to a digital video encoder 
62 . Both the video input and video output units can follow 

15 the CCIR656 format. For example, the video output unit can 

drive other CCIR656 -compatible devices such as a digital 
video tape recorder. An I^C interface 64 can also be 
included. An audio code unit 66 having a 16 -bit ADC and a 
16 -bit DAC for audio coding and decoding operations can be 

2 0 connected to the audio input and audio output units'. 

A synchronous serial interface 68 can be connected 
to a modem 70 for communicating with the server. The modem 
can be a V.34 modem capable of achieving a connection speed 
of 3 3.6 Kbps or greater over a standard telephone line or an 

2 5 ISDN modem interface. External circuitry to interface with 

incoming multimedia data streams can be connected to the 
processor as needed. 

The server 16 is a computer with which the client 
preferably can establish a connection with over a telephone 

3 0 modem. The server functions as the client's access to the 

internet so that the client can request documents, files and 
other information from other servers connected to the 
internet. For purposes of discussion, this server, which is 
part of an on-line service 26 for the user, will also be 
3 5 referred to as the POP or network server. The service 
provider can package content to address the information 
needs and interests of a diverse consumer marketplace. 
Updates to the operating and applications software used by 
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the processor of the client can be provided by the server as 
needed. 

The server 16 can also provide a page with links 
or shortcuts to internet content to be displayed in the 
5 graphical user interface ("GUI") or front -end of the client. 
These pages are displayed as part of a selection of channels 
for both internet content and television programming. The 
links provided by the server are to web pages which 
preferably have already- been screened by- the internet 
10 service provider for quality and'suitability . The links are 
classified into categories or topics within templates which 
can be stored on the server, the client, or both, to provide 
a framework for presenting these links through the interface 
of the client. 

15 The templates can be stored either on the client 

or the sever, depending on the available storage space on 
the client. The , templates can contain several different 
categories or topics from a given universe of topics. The 
cdTT.c cctcgcry cr top^c Tr*;^y be found z-n different cvcrlcippi.ng 

20. -templates. As illustrated -in FIG. 3, template I and 
template II are separate templates in which topics 1 and 3 
overlap. The topics associated with a template may be 
initially predetermined, and later adapted over time based 
on the past viewing and browsing interests of the user. 

25 The subject matter of the topics or categories are 

defined by predefined identifying attributes so that each 
category can' be defined by one or more of these attributes. 
These attributes can be associated with web pages in order 
to identify aspects of the subject matter or content of the 

3 0 page. As illustrated in FIG. 3, topic 1 is defined by the 
attribute a, topic 2 is defined by the attribute p, topic 3 
is defined by the attributes y and a, and topic 4 is defined 
by y and A. As an example, attribute o; may identify the 
subject of "sports," attribute 0 as "news," attribute 7 as 

35 "films," and attribute A as "science fiction." Topic 1 

would then include web pages having the attribute a for 
sports attached linked to web pages relating to films 
concerning sports would include both the sports attribute a 
and the films attribute y and would be sorted or categorized 
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as part of topic 3. Similarly, template I would include 
topics pertaining to sports, news, and sports films, while 
template II would include topics pertaining to news, sports" 
films, and science fiction films, as defined by the relevant 
5 attributes. 

The content of web pages may be described by one 
or more identifying attributes , and accordingly filtered 
into the categories or topics of the selected template. As 
illustrated in FIG. 4, a document having associated 

10 attributes of and (3 would be put in topics 1 and 2, while a 
document having only attribute 0 associated . therewith would 
only be classed as part of topic 2. As an example, a web 
page discussing "Rollerball, " a science fiction film with a 
sports theme, would be classed as part of topics 1, 3 and 4 

15 in both templates I and II. Prescreened web pages having 
been given identifying attributes can be classified 
according to those attributes and forced into the topics for 
the templates. 

While the template and its associated topics may 

20 be predetermined-, they can be later adapted automatically by 
an intelligent agent on either the client or the server 
based on the past viewing and browsing habits of the user. 
The client or server can record the attributes given for the 
web pages, and based on these recorded attributes, an 

25 algorithm may be used to modify the topics by adding 
attributes .or altering the relationship of the attributes to 
one another using boolean ("AND, OR, NOT") logic. As an 
example, topic 1 of template I could be modified to exclude 
the science fiction attribute A so that the Rollerball web 

3 0 page would not be present in topic 1 of template I. Based 
on the recorded attributes, new topics can be generated for 
the templates, or a new template can be generated 
altogether. 

The templates can be part of specific gateway 
35 interfaces tailored for specific user profiles. For 
example, the user may initially be required to select a 
general, preferably demographically-based, profile which may 
provide preselected web links in a predetermined set of 
categories. The particular graphical interface in which 
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these links are presented to the user can also be selected 

based upon the experience level and the amount of 

interactivity desired by the user, which may also . be 

automatically modified over time by an agent to fit the 
5 experience level of the user. 



The templates are preferably used in an active and 
dynamic interface on the television screen to the user. 
This may be referred to as active frame scrolling. The 

10 template may form part of a guide page with links to 

different preselected and precategorized web pages of 
interest. The guide page may include html codes, and may be 
a front -end window separate from the browser. The guide 
page may be represented as a channel from a menu of channels 

15 to be selected by the user in addition to traditional 
television programming channels. As previously discussed in 
connection with the templates, the guide page may be 
automatically modified, adapted, and updated by either the 
client or the server, and be based at least in part on past 

20 viewing and browsing nabits or cne user. 

The guide page may reside on the client, the 
server, or a combination of both. For example, the guide 
page may reside on the client, and be periodically updated 
by the server; or the template for the guide page may reside 

2*5 on the client while the content for the page is located on 
the POP server or another server identified by links in the 
guide page . 

The guide page can include a set of topics, and a 
set of links associated with each topic. The links 

3 0 preferably include an associated object such as a graphic 
image to visually indicate the subject matter of the link. 
The guide page provides a dynamic interface in that it 
scrolls through the links in order to provide the client 
user with a revolving choice of links. The guide page 

35 further includes the objects associated with the scrolling 
links which may be displayed as a sideshow presentation to 
the user. Alternatively, the interface can present the 
guide page with the objects associated with the scrolling 
links as a filmstrip presentation to the user. 

40 The selections of topics and links can be viewed 

as a series of sequences. For example, a first set of 
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seiected topics are displayed on the screen for the client 
user. One or a plurality of topics in a subset of the first 
set of topics is selectively highlighted in ' a first 
sequential order. For example, as illustrated in FIGS. 5 
5 and G, each succeeding displayed topic would be highlighted 
in descending order, and then the sequence would begin again 
at the top of the column of topics. 

A second set of internet links associated with the 
highlighted topic are displayed while, the first set of 

10 topics are being displayed. Each link preferably references 
a URL for a web document. The internet links of the second 
set are highlighted in a second sequential order. For 
example, as shown in FIG. 5, the highlighting of links would 
follow a descending order similar to that for the set of 

15 selected topics. When the second sequence of highlighting 

the links is completed, the next topic and then highlighted, 
and the links associated with the subject matter of that 
topic are highlighted in sequence. The next topic in the 
first sequential order is not highlighted until after the 

20. last, link in the second sequential order is highlighted. 

Alternately, the next topic is not highlighted until a 
preselected period of time passes, or until the user 
indicates that the system should proceed to the next topic, 
in order to allow the user adequate time to select a desired 

25 link. 

The dynamic revolving sequence of displaying 
graphics and sounds associated with particular highlighted 
links which are part of a set of links associated with a 
particular topic can be thought of as a series of nested 

30 loops. FIG. 6 is a flow chart generally illustrating the 
active frame scrolling which dynamically presents the 
topics, links, and associated descriptive objects according 
to a classification structure defined by a template. Where 
T represents the topic, and I an internet link connected 

35 with a particular URL, both are initially set to a value of 
one. If topic T and associated internet link T(I) are 
highlighted, associated object T(I)A is displayed on the 
interface as well. Next, while waiting for a predetermined 
amount of time tj to expire, the client may accept the user's 

40 selection of associated link T(I) and retrieve the web page 
at the URL connected with that link. If time t; expires and 
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there has been no selection by the user, then values T and 
I" are incremented, by one. First, internet link I is 
incremented and that next link can be highlighted, unless 
the value of I is greater than the number Z, of links 
5 associated with that topic T. In the latter situation, t is 
then incremented by one and that next topic is highlighted 
along with its associated links. If T is greater than the 
number Zj of topics for that template, then T is set back to 
one, and the scrolling sequence is started at the beginning. 
10 The order of these topics can of course be modified by the 
user at any time. 

The user can select the highlighted link by 
depressing a selection or enter button on the remote control 
device while that link is highlighted. Alternately, the 
15 user can use the remote control to manipulate a cursor to 
select a link or topic which is not highlighted. When the 
highlighted link is selected by the user, the internet 
r:onf.enr. . such as the page or document at the URL of the 

highlighted iinK, is aexiverea ^ix^ 1- — j — 

20 on the television screen. ■ 

While a link is highlighted, an object, such as a 
graphic image, animation, sound file, or a combination 
thereof, associated with the highlighted link is displayed 
on the television screen. By scrolling through the selected 
25 topics of the first set, the links of the second set 
associated with each selected topic, and the objects 
associated with- each link, as each are highlighted, a 
dynamic interface is presented to the client user. 

For example, as illustrated in FIG. 5, topic "2" 
30 is highlighted, and the associated links 2(1), 2(2), 2(3), 
etc., are displayed in association with highlighted topic 2 
for a predetermined amount of time. These links in turn are 
highlighted in sequence, and the object 2 (3) A associated 
with highlighted link 2(3) is displayed in the interface for 

3 5 a short period of time. 

Alternately, as illustrated in FIG. 7, the 
interface can present the guide page with the objects 
associated with the links scrolling from right to left as a 
filmstrip presentation to the user. The associated links 

4 0 and objects for several topics and several links can be 

shown simultaneously. The links and associated objects are 



displayed to the user as a dynamic sideways moving 
slideshow. After .pausing for a predetermined amount of 
time, one or more objects are moved out the frame at a time. 
Another set of topics and associated links and objects can 
5 be displayed in the interface after each of the previously 
displayed links has been shown in sequence. The associated 
objects can be displayed and scrolled in a horizontal 
sideways presentation, or in a vertically moving 
presentation. 

10 The interface preferably displays the associated 

object while the second set of links are also being 
displayed. The object may be stored on the client, the POP 
server, or on the server containing the URL for the 
highlighted link. For example, the associated object may be 

15 downloaded from the server when the link is first 
highlighted, preferably over a high speed, large bandwidth 
data connection such as a digital satellite or cable modem 
connection. Alternatively, the associated objects or 
graphics .may be downloaded periodically to the client and 

20. saved on the digital storage medium during off-peak hours in 
the early morning hours when usage is low in order to 
provide a fast dynamic interface to the user. Furthermore, 
the time required to establish a dial-up connection to the 
POP server can be reduced so as to be transparent to the 

25' user by initiating the connection' when the user initially 
selects the guide page from a menu of channels. Documents 
or web pages which are part of frequently visited web sites 
can also be automatically updated and downloaded during off- 
peak hours in order to allow for fast off-line browsing. 

30 After a link is selected by the user, and while the 
previously downloaded and stored web page is being viewed by 
the user, the client can establish a connection with the POP 
server to follow any links present in the web page and 
download other related or linked web pages which the user 

35 may predictably find of interest. 

The user may desire to switch quickly between 
internet content and television programming. An overlying 
menu of channels may be activated at any time on the screen 
40 to provide a single uniform interface to navigate among 
internet sites and television stations. Although television 
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stations have traditionally presented as local channels, 
internet address have generally not been represented as 
such. The web channels would be different from television 
channels in that web channels would represent a location or 
5 URL on a particular server. A guide page having links to 
URLs or shortcuts to such links can also be a separate 
channel on the overlying menu, preferably is in the form of 
a rotary wheel menu. 

As shown in FIG. 8, television stations and 

10 internet web pages can be presented as distinct channels on 
a single rotary wheel menu 80, The rotary wheel menu 
overlies the screen and allows the video or television 
programming to continue playing in the background, such as 
in the part of the display screen which is not occupied by 

15 the menu. This also applies to where the background is a 
web page so that animation and streaming video can continue 
to be updated. The user can directly select the next 
^u-,,^^^T ,.,v«^-K^>- ■;n^-or-no^ r^y ^A^#=^v^sion based , to be visited 
using the menu. The client can continuously poll ics i/u 

20 interface with the remote control device to detect user 
input or commands . 

The rotary wheel menu 80 is presented as a series 
of panels 82 which appear to occupy a three dimensional 
space extending behind the television screen. The panels 82 

2 5 on the front side of the rotary menu wheel 80 can be viewed 

on the television screen. The rotary menu wheel can include 
any number of panels, and displays a number of panels, such 
as five, seven or nine, which can remain legible on the 
front side of the menu wheel on the television screen. The 

3 0 remaining channels would not be displayed when rotated out 

of view to the back side of the wheel. Although the menu is 
described as a wheel for simplicity, the abstract geometric 
configuration of the menu need not be spherical. Although 
only a small fraction of the available number of panels may 

3 5 be visible in the interface at any one time, the menu wheel 
displayed can still simulate movement within a three- 
dimensional space when being rotated by causing the visible 
panels at the extreme top and bottom of the display screen 
appear faded and occupy a space behind another panel as the 

40 wheel is rotated. 



The panels can include text and graphics to 
describe and symbolize channels for particular television 
stations, internet web pages, and e-mail. Channels are 
selected by rotating the wheel in order to move the desired 
panel into a highlighting selection box 84. The simulated 
wheel can be rotated to move the panels up and down by 
manipulating the remote control device, such as by 
depressing an "up channel" or "down channel" on the remote 
control device. An enter or select button on the remote 
control device can be used to select the desired channel 
highlighted in the selection box. The user can also view 
the channels immediately adjacent to the channel highlighted 
in the selection box. 

The rotary menu wheel 80 resembles a Ferris wheel 
in certain respects in that the panels 82 remain facing the 
user even as the simulated wheel is being rotated. The text 
in the panels of the front half of the wheel facing the user 
maintains its dimensions and remains legible, even as the 
panels are rotated into different positions. The panels and 
accompanying text at the extreme top and bottom of the wheel 
begin to fade in order to further depict a three dimensional ■ 
space occupied by the wheel. .This is illustrated in FIG. 8 
by the dashed lines for the panels at the upper and lower 
extremes of the rotary wheel menu. 

Each panel is displayed according to its position 
on the wheel. .For example, the vertical coordinate for any 
one panel to be displayed on the television screen would be : 

y * sin{t) + Cy, 
where the vertical rotational radius y is set to 200, 
vertical coordinate constant Cy is set to 250, and the angle 
t of that panel is relative to the center of the simulated 
wheel lying on the center horizontal axis of the screen. 
The values of y and Cy are provided only to illustrate 
relative values which may be used to simulate vertical 
movement along a television screen. The above equation is 
applied when t is between -7r/2 and 7r/2 radians so that 
cos(t) is positive, and defines the front face of the wheel 
which would be visible to the user. Where cos(t) is 
negative, that panel would occupy the back side of the 
wheel, and should not be visible. The highlighted selection 
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box 84 should be located over the panel where t equals zero. 

As the angular position of the panel approaches' 
the zenith or the nadir of the wheel, the relative change in 
5 the vertical coordinates decreases as the sine curve levels 
off in approaching a value of one. The rate of vertical 
movement decreases so that the distance between adjacent 
panels decreases, and eventually overlap, towards the zenith 
and nadir of the simulated wheel. This causes the extreme 
10 panels displayed on the screen to appear to move behind the 
other displayed panels. 

As the panel is moved to the zenith and nadir of 
the wheel, the panel becomes more transparent. This also 
has the effect of previewing more channels on the wheel than 
15 if the panel remained opaque. Using the equation, 100 * 
cos(t), to define the transparency of the panel, it is 
apparent that cos(t) approaches zero to render the panel 
transparent as the panel approaches the respective zenith 
^»nH n^r^-ir r^f ^hR circle detined iDV cne wneex. inxs Lurunej: 
20 enha^nces the facade that the extreme panels displayed on the 

screen are behind the other displayed panels. 

In order to provide a more dimensional feel to the 
wheel, some horizontal movement can' be introduced in 
addition to the vertical movement so that the wheel appears 
25 to slightly trail off the screen as the panels approach 
either the apex or nadir of the visible screen. As before, 
the horizontal coordinate for the panel displayed would be : 

X * cos(t) + C„, 
where the horizontal rotational radius x is set to 10, 
3 0 horizontal coordinate constant Ch is set to 70, and t is the 
angle of the panel is relative to the center of the wheel 
and the center horizontal axis of the screen. The values of 
X and Ch are provided only to illustrate relative values 
which may be used to simulate slight horizontal movement of 

3 5 a panel along a television screen as the panel is moved to 

the extreme top or bottom of the screen. The wheel is given 
an apparent curved quality by this slight horizontal 
movement of the panel as the panel moves vertically. As 
before, this ec[uation applies only where cos(t) is positive. 

4 0 The highlighted selection box should be located over the 

panel where t equals zero, which should also represent the 
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maximum horizontal coordinate for the panel. Again, where 
cos(t) is less than zero, the panel would be on the back 
side of the wheel,, and should not be visible. 

The user can edit the channel list for the menu 
5 wheel. The user can bookmark particular web pages or si'tes 
to appear as new channels in the menu. wheel. Other channels 
may be added to the menu wheel for cable television 
channels, satellite channels, and other sources. Also, 
different menu wheels can be made available so that several 

10 different users can operate the system using different menu 
wheels with a personalized selection of channels. 

The channels can be organized as a circular queue 
and any suitable data structure is used to keep track of the 
channels in the queue. The queue is initially preloaded 

15 with channels, and any arbitrary channel can be set to 
correspond to the channel which is to be highlighted in the 
selection box. Thereafter, the last visited channel can be 
stored so that when the user returns to the menu, the menu 
wheel and panel for the last viewed channel is displayed and 

20 highlighted. Several panels of the channels adjacent to the 
highlighted channel are displayed on the screen. The 
channel order is preferably maintained during rotation of 
the wheel, even when rotated out of view. For example, if 
there are fifty consecutively numbered channels, then 

25 channel twenty-six should always be approximately opposite 
channel one in the simulated wheel of the rotary menu. 

FIG. 9 is a flow chart illustrating a process 
for implementing the menu wheel for selecting channels of 
content. The user first activates the wheel menu, and the 

3 0 client determines the position of the channels on the 
simulated wheel relative to the screen. The channels which 
would be visible on the front part of the simulated wheel 
are displayed on the television screen. 

If the user selects the command to rotate the menu 

3 5 wheel, the relative channel positions are updated, and the 
channels are moved vertically to animate the simulated 
movement of the wheel menu displayed on the television 
screen. A pointer can be used to track the position of a 
channel in the circular queue for the wheel. The pointer is 

40 updated, either by incrementing or decrementing the pointer 
in accordance with the user's commands. The movement of the 
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menu wheel is then animated in accordance with the user's 
commands. As the animation of the menu wheel is completed, 
the panels are displayed in the new position according to 
the pointer location in order to smoothly animate the 
5 movement of the. panels. 

If the user has entered a command to select the 
channel of the highlighted panel, the pointer value is 
saved, the menu wheel is no longer displayed, and the 
content of the selected channel is displayed on the 

10 television screen. Another routine can be launched where 
the selection of the channel requires additional processing, 
whether web browsing or television signal decoding. For 
example, where a user selects the guide page, the menu wheel 
routine is exited and the routine for presenting the dynamic 

15 guide page is executed. 

The remote control device can also select and 
scan between the channels representing the television 
broadcast and internet content through the ''up channel" and 
"finum nh;=inryf^l " in f.hR rRmnfce contr-ol device to move t>ack: and 

20 forth between channels, without first accessing the rotary 
wheel menu . 

The rotary wheel menu is part of a comprehensive 
interface from which the user can easily access internet 

25 content and television programming. The active frame 
scrolling of the interface actively presents the user with 
a revolving array of easily understood and identifiable 
links to web pages containing internet content. The links 
are presented with associated graphics to represent the 

3 0 subject matter of the linked web page. In presenting a 
comprehensive interface to the user, that interface should 
be concise in order to avoid overloading the user with too 
much information which may not be relevant to the situation. 

35 When accessing e-mail as opposed to browsing web 

pages, different commands are typically required. Further, 
when sending, reading, or retrieving e-mail, different 
commands are available for use. The same toolbar or menu 
interface is often used for these different e-mail 

40 situations, where the unnecessary or inappropriate commands 
are faded to indicate that they are unavailable to the user. 
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This can lead to confusion by inexperienced users because 
these faded out commands are often still visible. In one 
embodiment of the system, a specific dedicated menu for each 
situation, such as browsing, sending e-mail, reading e-mail, 
5 or retrieving e-mail, is made available to the user. 

For security of personal information, a password 
can be required before allowing access to personal e-mail or 
a web page containing personalized content. A series of 
10 graphical icons may be presented to the user, and the user 
selects a combination of these icons as a personal password. 

The television can include hardware commonly 
referred to as the V-chip which restrict access to channels 

15 carrying programming which has been given a certain rating 
such as TV-14 or TV-M. Internet blocking software is often 
used as an add-on to browsing software to filter out or 
restrict access to certain content such as explicit sexual 
content whioh would be inappropriate for young children. 

20 The criteria used by specific internet blocking software 
programs can vary. For example, internet blocking software 
may automatically scan the text of a particular web site and 
search out for groups of words that would be associated with 
inappropriate topics, and those pages which use those words 

25 are restricted from access by the browser. Another example 
is a voluntary system developed by the Recreational Software 
Advisory Committee provides a rating based on the content of 
a web site and users can block sites with high ratings of 
undesirable or inappropriate content . 

30 The present system uses a blocking filter which is 

compatible with one or more of the aforementioned internet 
blocking software systems and can convert or approximate 
ratings criteria used in the internet blocking software with 
that used to rate television programming. The user can set 

35 either the internet blocking software or the V-chip in the 
television to block both types of information or 
programming. For example, where the user sets the system to 
block programming with a television rating of TV-14, the 
browsing software will be modified by the client to block 

40 web sites on the internet having comparable content. The 
client will have a conversion capability to take the 
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criteria used by the blocking software and compare it to 
predetermined set of criteria for the television rating 
system. Furthermore, the client can also function as the V- 
chip for television programming if one is not included in 
the television set.. 

A service can be provided through the server, 
where the server acts as a quality control gatekeeper that 
presents selected links to web pages. While the user is 
free to explore outside of the universe developed by the 
server, less experienced users can explore the more 
controlled environment provided by the server. The links to 
other web pages created and maintained by other internet 
entities and organizations will be preselected or accredited 
by the service for the quality of their content. After 
being initially set up, web sites are often not adequately 
maintained or updated. The staleness of a web site can be 
a factor in determining the quality of its content. 

Unliltc nr. cn-lir-* c/a-rvir-p wmcn creates cttiu 
provides its own specialized content, the server will 
provide links to content created by other entities on the • 
internet, wherein those links will be categorized and 
organized according to the templates. The server, 
preferably the POP server, acts as the gateway to the linked 
web pages for the client. The links present in those 
templates for an individual user will be modified over time 
based on that user's pattern of usage and the subject matter 
of the user's browsing. 

An intelligent agent on the POP server can monitor 
the identifying attributes of the preselected linked web 
pages provided by the server. The intelligent agent can be 
an anchored agent, and does not need to be a self-contained 
mobile agent carrying their own state information and moving 
from server to server. The agent will record the attributes 
of previously visited web sites from the guide page 
containing the links provided by the server. The 
intelligent agent can identify subject areas of interest for 
the user based on the past viewing and browsing habits of 
the client user in order to determine the user's preferences 
for the selected topics provided in the templates. However, 
the agent does not necessarily rate the quality of the 



content of the web pages . Instead, as illustrated by the 
flow chart in Fig. .10, the agent follows a macromanagement 
approach which presents categories of links according to 
topics within a template. The topics are defined by 
attributes which describe subject matter, and the attributes 
are associated with the linked web pages. The attributes 
can be attached to a web page link after being reviewed by 
the service running the POP server, or they can be 
voluntarily provided by the web site hosting the web page 
itself, or determined through an algorithm parsing the text 
of the web page. 

Predetermined codes can be provided as part of 
data transmitted on a television signal to identify the 
genre of a television program being broadcasted. A 
television receiver which is capable of monitoring and 
storing the predetermined genre codes for television 
programming in order to select programs based on past 
viewing habits is disclosed in U.S. Patent No. 5,585,865 
("Amano, et al . " ) , which is hereby incorporated by 
reference. These genre codes can be consistent with or 
convertible to the attributes associated with web pages in 
order to provide additional infoormation to the agent to 
determine areas of interest for the client user. The client 
processor can store the genre codes associated with 
previously viewed television programming, and then provide 
this data to the agent to augment its web browsing data. 

The web pages are classified into the categories 
or topics of the templates selected by the client user. 
These attributes associated with the web pages identify 
aspects of the subject matter or content of the page. FIGS. 
3 and 4 illustrate the relationship between the templates 
and the documents having associated attributes for 
classification into • the topics of the templates. 
Prescreened web pages having been given identifying 
attributes can be classified according to those attributes 
and forced into the topics for the templates. As an 
example, attribute a may identify the subject of "sports," 
attribute P as "news, " and a document or web page having 
both attributes associated with it would be classed in both 
topics 1 and 2, and would be displayed as a link in either 
template I or II. As another example, a web page having 
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attributes a, A and y and would be classed as part of topics 
i; 3 and 4 in both templates I and II, 

While the template and its associated topics may 
be predetermined, and they can be later adapted 
automatically by the intelligent agent based on the past 
viewing and browsing habits of the user. The client or 
server can record the attributes given for the web pages, 
and based on these recorded attributes, an algorithm may be 
used to modify the topics by adding attributes or altering 
the relationship of the attributes to one another using 
boolean logic. As an example, topic 1 of template I could 
be modified to read as attribute or NOT attribute A so that 
the web page associated with attributes a, A and 7 would not 
be present in topic 1 of template I. Based on the recorded 
attributes indicating the user's topical areas of interest, 
new topics can be modified or generated for the selected 
templates, or a new personalized template can be generated 
altogether upon request. 

'i'ne agent- p x. e i- e jl du j. y to«cLj.uiic* uixj. u/ul^j.* o vj.cn„ctJ-/»^<- 
of web links which have been compiled by the service to 
present to the user through the guide page in the graphical 
user interface. The agent can be focused on the web pages 
already screened, rated and categorized by the service. The 
links to web pages can be determined to be suitable by the 
service based' on overall quality considerations, and given 
identifying attributes either manually or by a word parsing 
algorithm based .on the occurrence of relevant words in the 
web page . 

The guide page presented as part of the graphical 
user interface can be modified over time. The intelligent 
agent, located either on the client or server, is capable of 
automatically modifying, adapting, and updating the guide 
page based at least in part on past viewing and browsing 
habits of the user. The guide page is based on a template 
which organize and categorize the predetermined web links to 
the user. The filtering by the agent does not search out 
the entire content of the internet, but only that which has 
been preselected for inclusion with the templates for the 
user. Although the templates and associated topics may be 
initially selected by the user, the agent may modify the 
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topics contained in the templates and filter the preselected 
contents accordingly for that template. 

The agent provides additional links to web pages 
which have been classified in one or more of the topics set 
5 forth in the selected template for the guide page displayed 
to the client user. Thus, the guide page interface provides 
an active presentation, to the user of the current links 
currently in the guide page, while updating and revising the 
links periodically to provide new and current links to the 
10 user so that template does not become stale. 

In order to present the client user with a more 
coordinated and faster internet experience more akin to 
television viewing, the bandwidth capacity of the data 

15 connection between the client and server needs to be much 
greater than that currently available using analog modem 
connections over existing telephone lines. The bandwidth 
from all possible and available data connection sources 
should be utilized for maximum efficiency. 

20, . Several . different data connection sources may be 

available to the client, including telephone modems, ISDN 
lines, digital satellite data services, and cable modems. 
The client can utilize several different types of data 
connections simultaneously. Both television and computer 

25 data can be multiplexed and provided to the client over the 
same digital satellite connection. For example, the client 
can utilize both a telephone modem and a digital satellite 
service, where the satellite service provides both 
traditional television programming, as well as internet 

3 0 content in the blanking signal of the television programming 
or otherwise incorporated into the digital data stream. 
Content which is personalized could be received by the 
telephone line, while the satellite connection is used to 
receive information of broader appeal which is selectively 

35 received by a filtering mechanism in the client. 

A digital satellite service separate from a DBS 
for television programming can download digital computer 
data at a rate of about 400 Kbps . However, such a service 
could be expensive, with additional connect fees based on 

40 each megabyte of data downloaded. However, by using an 
analog modem to download text which does not require a large 
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bandwidth for rapid downloading, some download connect fees 
can be avoided. Text for other linked web pages can be 
downloaded over the modem connection while he user is 
reading or viewing another page containing the links. 
5 Either the client or the server can automatically initiate 
downloading at off-peak hours as previously discussed in 
order to efficiently use the available data connections to 
download data to the client for access by the user. The 
standard modem connection can also be used to download text 

10 and other data to update current links and associated 

objects or content while the user is on-line and browsing, 
but not actively downloading documents, so as to utilize the 
modem connection which would otherwise remain idle. 

As shown in FIG. 11, the client is capable of 

15 demultiplexing data from both pipelines, where graphics, 
sound, and video files are preferably downloaded over the 
larger and faster pipeline having more bandwidth such as a 
digital satellite connection. Less bandwidth-demanding text 
and data file'? r^^r) b<a p-rovi ded over tne moaem connection in 

20 order to . efficiently use of all available bandwidth sources. 

Data files provided over the modem connection can be used to 
indicate which files are being transferred over which data 
connection, and to coordinate the presentation of the data 
being provided over the larger bandwidth. For example, 

25 different text, sound and animation files may be coordinated 
to produce a dynamic sideshow presentation to the user. 

When establishing a remote data connection, the 
server and client initially perform a handshake to establish 

3 0 communication protocols. The server can further query the 
client regarding its available data stream connections, 
including telephone modems, cable modems, and digital 
satellite broadcasting, as illustrated in FIG. 12, in order 
to determine the most efficient delivery of different types 

3 5 of data through all of the available bandwidth connections. 

Different types of data files can be divided from one 
another and the data files delivered over the different data 
connection depending on " the type of data file being 
transferred, the size of such files, and the bandwidth 

40 available for the different data connections. Data arriving 

over the different data connections are demultiplexed by the 
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client . The efficient delivery of data allows the client to 
present text, graphics, video, audio and other multimedia 
information from a web page over the internet as a fast and 
coordinated presentation. A closer working relationship can 
5 also be developed as a result of the querying between 'the 
server and the client in order to develop a more efficient 
allocation of . processing and storage burdens and 
responsibilities between the client and the server. Clients 
with limited storage capacity can utilize space on the 
10 server for certain functions. 

Data is often compressed for more rapid delivery 
over the limited bandwidth currently available. Different 
types of data files, such as sound', video and graphics 

15 files, are often compressed at different rates and ratios, 
often using different compression schemes. For example, 
video data can be compressed using the MPEGl or MPEG2 
standards, audio data as wav, au or aiff files, and graphic 
images can be compressed using either the JPEG or GIF 

20 standards. Such data may be decompressed at different 

rates, and the client may include specific hardware or' 
software, or a corT±>ination of both, to properly synchronize 
the decompression of data for a document or file for 
simultaneous and coordinated presentation to the user of, 

25 for example, different combinations of sound and animation 
files. Different selected sound and animation files can be 
mixed and matched, and used together for different 
occasions, and can be synchronized for a coordinated 
presentation to the client user. 

30 

From the foregoing it will be appreciated that the 
system of the present invention provides advantages in 
presenting information in a simple, intuitive manner, while 
making the most efficient use of the available bandwidth 
35 source connections. While several particular forms of the 
invention have been illustrated and described, it will be 
apparent that various modifications can be made without 
departing from the spirit and scope of the invention. 
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CIAIMS 

1. A system for selectively displayin-g. 
internet content and television programming on a 
display, the system comprising: 

a client, including, a display, and channels 
separately representing individual television 
content and individual internet contents- 
means for selecting between the channels 
wherein when an individual television content 
channel or an individual internet content channel 
is selected the client presents the content 
associated with the selected channel on the 

displays- 
means for presenting on the display an 
internet gateway interface which selectively 
scrolls through links to selected web pages 
organized according to templates corresponding uo 
web page content displayed on internet content 

channels; and 

a server, including means for establishing a 

aaua t_;uiiii'5\-' u -lwh w**w ^ — — - - - 

data along the data connection to the client. 

2. A system according to claim 1 wherein 
the selecting means comprises a rotary wheel menu 
for enabling the user to select a channel. 

3. A system according to claim 2 wherein 
the menu provides a single uniform interface to 
enable the user to navigate among the channels of 
the internet sites and television stations. 

4. A system according to claim 1 wherein 
the presenting means comprises a dynamic interface 
including means for scrolling through selected 
topics of a first set, links of a second set 
associated with each selected topic and objects 
associated with each link. 

5. a system according to claim 1, wherein 
the server includes means for passively filtering 
selected web pages for a user to explore based on 
the user' s past usage of the client . 

6. A system according to claim 5, wherein 
the filtering means modifies the links to selected 
topics present in the templates by monitoring the 
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user's use of the client to determine the user's 
preferences for " the selected topics in the 
templates . 

7 A system according to claim 1, wherein 
the server includes means for querying the client 
regarding its available data connections to 
determine the most efficient delivery of different 
types of data through all available bandwidth 
connections . 

8. A system as set forth in claim 1,2, 3, 
4, 5, 6 or 7^ wherein the client includes a video 
input, at least one data communication line, and a 
digital storage medium, the client is capable of 
displaying video from the video input and data from 
rhe digital storage medium on the display, the 
server is connected to the client by the 
communication line, the server being capable of 
communication with a plurality of other servers, 
wherein the server and the client can communicate 
with one another such that documents from the other 
servers can be provided to the client and stored on 
the digital storage device, and the server further 
includes a database categorizing a number of 
documents from the other servers into topics of 
interest according to pre-selected criteria. 

5. A system as set forth in any preceding 
claim wherein the client includes a set top box, 
connected to the display, for providing connections 
to video and computer data sources to be processed 
and displayed on the display. 



10. A system as set forth in any preceding 
claim, wherein the display comprises a television 
screen . 



11. A system as set forth in any preceding 
claim, wherein data connection between the client 
and server includes a telephone modem. 

12. A system as set forth in any preceding 
claim, wherein the client further includes a 
processor for performing multimedia tasks, 
programming for the internet web, browsing, and 
controlling multimedia tasks. 
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13. A system as set forth in any preceding 
claim, wherein the 'client further includes a remote 
control device. 

14. A system as set forth in any preceding 
claim, further comprising means for 
alphanumerically entering text. 

15. A system as set forth in any preceding 
claim, ■ wherein the data connection to the client 
comprises a satellite service for delivering 
television programming and for delivering in-erne^ 
content during the t:elevision programming blanking 
signal . 

16. A system as set forth in any preceding 
claim, wherein the data connection comprises an 
ISDN connection. 

17. A system as set forth in any preceding 
r-i^im. wherein the data connection comprises a 
digicai sdudlii-ti dau.a 3crvi.cc. 



18. A system as set forth in any preceding 
claim, wherein the data connection comprises a 
cable modem. 

19. A system as set forth in any preceding 
claim., wherein the server comprises a nerwcrk 
server for enabling the client to access the 
internet so that the client can request information 
from other servers connected to the internet, 

20. A system as set forth in any preceding 
claim, wherein the client further comprises a 
graphical user interface, and the server includes 
means for providing the graphical user interface 
with a page with links to internet content. 

21. A system as set forth in any one of 
claims 1, 4, 5, 6 and 7, further comprising a menu 
for providing a single uniform interface to enable 
the user to navigate among the channels of internet 
sites and television stations. 

22. A system as set forth in any preceding 
claim, wherein the internet channels represent a 
URL on a particular server. 
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23. A system as set forth in any preceding 
claim, further comprising a service interconnected 
with the server, for providing quality control in 
presenting selected links to web pages by 
preselecting links to other web pages created and 
maintained by other internet entities and 
organizations . 

24. A system as set forth in any preceding 
claim, wherein the templates categorize and 
organize the links. 

25. A system as set forth in any one of 
claims 1 to 4, further comprising a plurality of 
dedicated menus, each for a different command 
function including a plurality of different 
customized controls . 

26. A system as set forth in any preceding 
claim, further comprising means for filtering and 
blocking internet content and television 
programming, compatible with television and 
internet blocking filters. 

27. A system as set forth in any preceding 
claim, further comprising means for demultiplexing 
data to the client, which comprise m.eans for 
downloading graphics, sound, or video files over a 
^Large bandwidth data connection. 

28. A system as set forth in any preceding 
claim, further comprising means for synchronizing 
decompression of different types of data files for 
simultaneous and coordinated presentation to the 
user . 

29. A system as set forth in claim 8, 
wherein the server monitors documents requested by 
the client in order to determine the topics of 
interest to the user of the client. 

30. A system as set forth in claim 8, 
wherein the server yP^^vides suggestions to the 
client for additional documents categorized into 
the topics of interest' from the other servers. 
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31. A system as set forth in claim 8, 
wherein the digital storage medium comprises a hard 
drive . 

32. A system as set forth in claim 8, 
wherein the digital data storage medium comprises a 
digital video disk. 

33. A system as set forth in claim 8, 
wherein the digital storage medium comprises a 
digital video tape. 

34. A system as set forth in claim 10, 
wherein the television screen comprises a cathode 
ray tube. 

35. A system as set forth in claim 10, 
wherein the television screen comprises a liquid 
crystal display. 

'^(^ c;\/c:t-(=^Tn p <^ Pif^.t, forth in claim 13, 

wherein tne remote com:roi device incluuei^ nuxneric 
keys for selecting channels. 

37. A system as set forth in claim 13, 
wherein the remote control device includes 
directional controls for controlling movement of 
selection means on the television screen. 

38. A system as set forth in claim 13, 
wherein the remote control device includes a button 
for activating a link or command. 

39. A system as set forth in claim 13, 
wherein the ^ remote control device includes 
dedicated keys for jumping to a specialized 
function . 

40. A system as set forth in claim 14, 
wherein the entering means comprise a keyboard. 

41. A system as set forth in claim 15 or 
27, wherein the video connection comprises a 
digital satellite broadcasting connection. 

42 . A system as set forth in claim 15 or 
27, wherein the video connection comprises a cable 
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43. A system as set forth in claim 20, 
wherein the server links are predetermined web 
pages screened by the internet service provider. 

44. A system as set forth in any preceding 
claim, wherein the templates include links 
classified into categories, which templates provide 
a framework for presenting the links in the client 
graphical user interface. 

45. A system as set forth in claim 21, 
wherein the menu comprises a rotary wheel menu. 

46. A system as set forth in claim 21, 
wherein the menu further includes a separate 
channel for a guide page having links to URLs. 

47. A system as set forth in claim 2, 3 or 
21, wherein the menu overlies the screen, so as to 
enable video or television programming to continue 
in the background on the display. 

48. A system as set forth in claim 23, 
wherein the service determines the staleness of a 
web site based on adequacy of maintenance or 
updating thereof. 

49. A system as set forth in claim 24, 
further com.prising means for modifying the links zo 
selected topics present in the templates by 
monitoring the user's use of the client to 
determine the user's preferences for the selected 
topics in the templates . 

50. A system as set forth in claim 25, 
wherein a dedicated menu function comprises web 
brows ing . 

51. A system as set forth in. claim 25, 
wherein a dedicated menu function comprises sending 
E-Mail. 

52. A system as set forth in claim 25, 
wherein a dedicated menu function comprises reading 
E-Mail. 
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53. A system as set forth in claim 25, 
wherein a dedicated menu function comprises 
retrieving E-Mail . 

54. A system as set forth in claim 26, 
wherein the filtering and blocking means are 
adapted to correlate rating criteria in internet 
blocking software and television programming. 

55. A system as set forth in claim 44, 
wherein the templates are stored on the server. 

56. A system as set forth in claim 44, 
wherein the templates are stored on the client. 

57. A system as set forth in claim 44, 
wherein the templates are stored on the server and 
the client . 

58. A system as set forth in claim 44, 
T.THo-no-i-n t*hf= r^emnlates include a plurality of 
dxtterem: cax:eg<ji.lei> , xiiv-ludj-ng web page content 
defined by predetermined identifying attributes 
identifying aspects of the subject matter of the 
web page content , 

59. A system as set forth in claim 6 or 44, 
further comprising an intelligent agent for 
filtering web pages content inro categories on the 
template, enabling automatic adaptation of the 
template and associated categories based on the 
past user viewing habits. 

60. A system as set forth in claim 44, 
further comprising an active television screen user 
interface including the templates. 

61. A system as set forth in claim 44, 
including a guide page comprising a template 
including links to different preselected pre 
categorized web pages of user interest. 

62. A system as set forth in claim 2, 3 or 
45, wherein the rotary wheel menu comprises a 
series of panels which appear to occupy three- 
dimensional space including extending behind the 
television screen, wherein the panels on the front 
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side of the rotary wheel menu can be viewed on the 
television screen. 

63. A system as set forth in claim 2, 3 or 
45, further comprising means for rotating the 
rotary wheel menu to simulate movement within a 
three-dimensional space, causing the visible panels 
other than the forwardmost panel to be behind other 
panels as the wheel is rotated. 

64. A system as set forth in claim 2, 3 or 
45, further' comprising means for highlighting a 
selection box for-a desired panel to rotate into. 



65. A system as set forth in claim 2, 3 or 
45, further comprising a remote control device, and 
means on the remote control device for enabling 
movement of the panels up and down. 



66. A system as set forth in claim 2, 3 or 
45, wherein the rotary wheel menu resembles a 
Ferris Wheel, with the panels remaining facing the 
user as the wheel is rotated. 

67. A system as set forth in claim 2, 3 or 
45, wherein the distance between adjacent panels 
decrease.s and eventually overlaps towards the 
zenith and nadir of the rotary wheel, whereby the 
extreme panels displayed on the screen appear ro 
move behind other displayed panels. 



68. A system as set forth in claim 2, 3 or 
45, wherein the panel becomes more translucent as 
the panel moves to the zenith and nadir of the 
wheel . 

69. A system as set forth in claim 53, 
wherein the intelligent agent is adapted to 
automatically modify, adapt, and update the guide 
page and templates and to organize and categorize 
the predetermined web links to the' user based at 
least in part on past user viewing and browsing 
habits . 



70. A system as set forth in claim 59 or 
69, wherein the intelligent agent searches that 
portion of the content of the internet preselected 
for inclusion with the templates for the user. 
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71. A system as set forth in claim 59, 69 
or 70, wherein the intelligent agent modifies the 
topics contained in the templates and filter the 
preselected topics accordingly for that template. 

72. A system as set forth in claim 51, 
wherein the guide page comprises a channel 
selectable by the user. 

73. A system as set forth in claim 61, 
wherein the guide page is further adapted to be 
automatically modified. 

74. A system as set forth in claim 61 or 
73, wherein the guide page is stored on the server. 

75. A system as set forth in claim 61 or 

73, wherein the guide page is stored on the client. 

76. A system as set forth in claim 61 or 
and the server. 

77. A system as set forth in claim 61, 73, 

74, 75, 76 or 77, wherein the guide page includes a 
set of topics, and a set of links associated with 
each topic. 

78. A system as set forth in claim 61, 73, 
74, 75, 76 or 77, wherein the guide page comprises 
a dynamic interface for scrolling through links to 
provide the client user with a revolving choice of 
links . 

79. A system as set forth in claim 65, 
further comprising means on the remote control 
device for selecting the desired channel, which is 
highlighted in the selection box. 

80. A system as set forth in claim 73, 
wherein guide page adaptation is based in part on 
past user viewing habits . 

81 A system as set forth in claim 77, 
wherein the links include an associated object for 
visually indicating the subject matter of the link. 
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82. A system as set forth in claim 11, 
wherein the guide page topics and links are 
selectable in a series of sequences. 

83. A system as set forth in claim 77, 
further comprising a remote control device for 
selecting a link to deliver the internet content ro 
the client for display on the television screen. 

84. A system as set forth in claim 78, 
wherein the guide page further includes associated 
objects for the scrolling links. 

85. A system as set forth in claim 81; 
wherein the associated objects are displayed as a 
slide show presentation to the user.. 

86. A system as set forth in claim 81, 
wherein the associated objects are displayed as a 
filmstrip presentation to the user. 

87. A system as set forth in claim 82, 
wherein the series of sequences comprises a first 
set of selected topics displayed on the screen for 
the client user, and a subset of the first set of 
topics selectively highlighted in a first 
sequential order. 

88. A system as set forth in claim 83, 
wherein the remote control device includes 
selection buttons for selecting a highlighted link. 

89. A system as set forth in claim 83, 
wherein the remote control device includes a cursor 
for selecting a non-highlighted link. 

90. A system as set forth in claim 84, 
further comprising means for actively scrolling 
through frames to dynamically present topics, 
links, and associated objects according to a 
template-defined classification structure . 

91. A system as set forth in claim 85, 
wherein the slide show presentation comprises a 
dynamic sideways moving slide show of 
simultaneously shown links and associated objects 
for a plurality of topics. 
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92. A system as set forth in claim 82, 87 
or 88, wherein each succeeding displayed topic is 
highlighted in descending order, and the sequence 
begins again at the first set of topics. 

93. A system as set forth in claim 87, 
further comprising a second set of internet links 
associated with the first set of topics. 

94. A system as set forth in claim 88; 
wherein upon highlighting a link, an object 
associated with the highlighted link is displayed 
on the television screen. 

95. A system as set forth in claim S3, 
wherein the second set of internet links are 
highlighted in a second sequential order. 

96. A system as set forth in claim 94, 
wherein the object comprises a graphic image. 

wherein the object comprises an animation. 

98. A system as set forth in claim 94, 
wherein the object comprises a sound file. 

99. A system as set forth in claim 94, 
wherein the object is stored on the client. 

100. A system as set forth in claim 94, 
wherein the object is stored on a network server. 

101. A system as set forth in claim 94, 
wherein the object is stored on the server 
containing the URL for the highlighted link. 

102. A system as set forth in claim 94, 
further comprising means for enabling downloading 
the associated object from the server when the link 
is first highlighted. 

103 A system as set forth in claim 100, 
further comprising means for establishing a 
connection with the network server after a link is 
selected by the user and while the previously 
downloaded web page is being viewed, to follow 



links present in the web page and download other 
related web pages of user interest. 



104. A system as set forth in claim 27 or 

102, wherein the downloading enabling means 

comprise a high speed, large bandwidth data* 
connection . 



105. A system as set forth in claim 
102, further comprising means for enabling 
downloading of the associated object periodically 
to the client, and saving thereof on the digital 
storage medium during off-peek low usage hours. 

106. A system as set forth in claim 102, 
wherein the downloading enabling means further 
automatically updates web pages which are part of 
frequently visited web sites. 

107. A system as set forth in claim 102, 
further comprising means for providing a 
substantially fast user interface to the user, 

108. A system as set forth in claim 103, 
wherein the data connection comprises a digital 
satellite connection . 



109. A system as set forth in claim 105, 
further comprising means for initiating a dial-up 
connection to the network server when the user 
initially selects the guide page. 

110. A system as set forth in any one of 
claims 19, 100 and 103, wherein the network server 
is a POP server. 

111. A method of selectively displaying 
internet content and television programming on a 
display, the method comprising the steps of: 

establishing a ^connection between a 
client which includes a display and channels 
separately representing individual television 
content and individual internet content and a 
server, for downloading data from the server along 
a data connection to the client; 

presenting on the display an internee 
gateway interface which actively scrolls through 
links to selected web pages- organized according to 
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templates corresponding to web page content 
displayed on internet content channels; and 

selecting between the channels, wherein when 
an individual television content channel or an 
individual internet content channel is selected the 
client presents the content associated with the 
selected channel on the display, 

112. A method according to claim 111, 
wherein a rotary wheel menu selects between the 
channels . 

113. A method according to claim 111 further 
comprising passively- filtering .selected web pages 
for a user to explore-based on the user's past 
patterns of usage of the client. 

114. A method according to claim 111 further 
comprising querying the client regarding irs 
available data connections to determine the most 
efficient delivery of different types of data 

4.'UuAt<.>w'U -slT raTr-^-iT^V^TiSi V-\ar-*/^T.rT/-1+-l-^ ^/-\y-\-r\^r*-f'-^r^-r^c 

115. A method according to claim 111/ 
including scrolling through selected topics of a 
first set, links of a second set associated with 
each selected topic, and objects associated with 
each link, 

116. A system for alternately 
displaying internet content and a television 
program signal on a television screen, the system 
comprising : 

a client including a video input and at 
least one data communication line, and a digital 
storage medium; 

a display connected to the client, wherein 
the client is capable of displaying video from the 
video input and data from the digital storage 
medium on the display; and 

a server connected to the client by the 
communication line, the server being capable of 
communication with a plurality of other servers, 
wherein the server and the client can communicate 
with one another such that documents from the other 
servers can be provided to the client and stored on 
the digital storage device, the server further 
having a database categorizing a number of 
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docuinents from the other servers into topics 
according to pre-selected criteria; and 

wherein the server monitors documents 
requested by the client in order to determine the 
topics of interest to the user of the client, and 
the server provides suggestions to the client for 
additional documents categorized into the topics of 
interest from the other servers. 

117. A system for alternately 
displaying internet content and a television 
program signal on a television screen, the system 
comprising : 

a client including a television screens- 
means for selecting between channels 
separately representing individual television 
content and individual internet content, wherein 
when an individual television content channel is 
selected, the client presents television content 
associated with the selected individual television 
content channel; 

means for presenting a set of internet links 
when the internet content channel is selected, and 
automatically scrolling through and sequentially 
highlighting each link one at a time; 

means for selecting one of the highlighted 
internet links; 

a server capable of establishing a 
connection with the client and capable of 
downloading data along at least two data 
connections to he client, the server further being 
capable of querying the client to determine the 
number of data connections currently available to 
the client, the client having means for 
demultiplexing data from the server through the at 
least two data connections; and 

means for implicitly determining the topical 
preferences of the user of the client based on the 
pattern of usage by the client. 

118. A method for alternately 

displaying internet content and a television 
program signal on a television screen, the method 
comprising the steps of: 

displaying a menu allowing a user to select 
between channels representing particular internet 
content, a guide page for internet content, and 
particular television signals; and 
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displaying the particular content 

represented by the channel selected by the user on 
the television screen. 

119. The method of claim 118, further 
comprising the step of displaying the guide page on 
the screen when the channel representing the guide 
channel is selected by the user, wherein the step 
of displaying the guide page includes -the steps of: 

displaying a first selection of topics; 
highlighting the topics in a first sequential 
order; 

displaying a second selection of 
internetlinks associated with the highlighted topic 
while the first selection of topics are being 
displayed, wherein each internet link references an 
internet address; 

highlighting the internet links of the 
second selection in a second sequential order, 
wherein the next topic in the first sequential 

oraer is iiwl iixyiij-xym-c^ ^xx^^.^ ■ 

in the second sequential order is highlighted; 

displaying an object associated with the 
highlighted internet link while the second 
selection of links are being displayed; and 

displaying on the television screen the 
internet content at the internet address referenced 
by the internet link selected by the server . 
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(57) Abstract 



An internet on-demand system for television presents internet content and traditional television programming as part of a single 
coherent interface. The system includes a server and a client capable of providing a dynamic graphical user interface. The system can 
display an internet gateway interface which actively scrolls through and highlights links to selected web pages which are organized according 
to templates corresponding to their content. The web pages are presented on the graphical user interface as channels as part of the same 
milieu as channels of traditional television programming. The user, can select a channel from a rotary menu wheel or via channel-up, 
channel-down buttons on the remote control device. An intelligent agent passively filters selected web pages for a user to explore based on 
the user's past pattern of usage of the client. The server queries the client regarding its available data stream connections, including telephone 
modems, cable modems, wireless telecommunications and digital satellite broadcasting, regarding its ability to detect embedded data in TV 
signals, in order to determine the most efficient delivery of differenttypes of data through all of the available bandwidth connections for 
both directions of data flow. The efficient delivery of data allows the client to present text, graphics, video, audio and other multimedia 
information from a web page over the internet as a coordinated presentation. 



BNSDOCiD: <WO 9B56188A3_f_> 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCX on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Annenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 
Burkina Faso 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


uz 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


2W 


Zimbabwe 


CI 


C6te d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






CU 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






CZ 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Gennany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







A. CLASSIFICATION OF SUBJECT MATTER 

IPC 6 H04N5/00 H04N5/445 H04N7/14 



According to Internationat Patent Classifrcation (IPC) or to both national dasslfication and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 6 H04N G06F 



Documentation searcfied other than minimum documentation to the extent that such documents are Included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 



C. DOCUMENTS CONStDERED TO BE RELEVANT 



Category "* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


X 


wo 97 13368 A (BRIEN SEAN ANDREW 0 ;MILNES 


1.4-6, 




KENNETH ALAN (US); SCHEIN STEVEN MICHA) 


8-14, 




10 April 1997 


17-22, 






24.25, 






27,31, 






34, 






39M2 , 






44,46, 






47, 






49-53, 






55-58, 






61,65, 






73-84 


X 




87,88, 






90,92, 






104,110, 






111,115, 






117,118 


Y 




2,3,15, 




-/- 



Further documents are listed in the continuation of box C. 



Patent family members are listed in annex. 



" Special categories of cited documents : 

"A" document defining the general state of the art which is not 
considered to be o( particular relevance 

"E" earlier document but published on or after the international 
filing dale 

"L" document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use. exhibition or 
other means 

'P" document published prior to the international filing date but 
later than the priority date claimed 



"T" later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theorv underiying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Dale of the actual completion of the Internationa) search 

27. November 1998 


Date of mailing of the international search report 

1 2. 01. 99 


Name and mailing address of the ISA 

European Patent Office. P.B. 5818 Patentlaan 2 
NL . 2280 HV Rijswijk 
Tel. (+31-70) 340-2040. Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 


Authorized officer 

Sindic, 6 



FofTT) PCT/iSA/210 (second aheet) (July 1992) 



page 1 of 3 



BNSDOCID: <WO_ 



INTERN. .ONAL SEARCH REPORT 



Intent. ' al Application No 

PCT/IB y8/00895 



C.(Contlnuation) DOCUMENTS CONSIDERED TO BE RELEVANT 


Category ' 


Citation of document, with tndication.where appropriate, of the relevant passages 


Relevant to claim No. 



see page 

see page 

see page 

see page 

see page 

see page 

see page 

see page 

see page 

see page 



2, line 37 - 
4, line 1 - 

9, line 1 - 

10, line 13 
19. line 10 
25, line 28 
28, line 7 - 
30, line 26 
32, line 37 
34, line 6 - 



page 3, line 22 
page 5, line 20 
line 17 

- 1 ine 35 

- page 21, line 

- page 26, 1 ine 
line 17 

- page 31 , 1 ine 

- page 33, 1 ine 
line 22 



33 
11 

19 
20 



WITTIG H ET AL: "INTELLIGENT MEDIA AGENTS 
IN INTERACTIVE TELEVISION SYSTEMS" 
PROCEEDINGS OF THE INTERNATIONAL 
CONFERENCE ON MULTIMEDIA COMPUTING AND 
SYSTEMS, 15 May 1995, pages 182-189, 

vDnnncrvo /lo^ 

see page 162, right-hand column, paragraph 
1 

see page 183, left-hand column, paragraph 
2 

see page 186, left-hand column, paragraph 
4 

see page 187, left-hand column, paragraph 
4 - right-hand column, paragraph 1 

"VERKNUEPFUNG VON TV MIT INTERNET" 
FUNKSCHAU, 

vol. 68, no. 18, 16 August 1996, page 
70/71 XP000631189 

see page 70, middle column, paragraph 3 - 
page 71, left-hand column, paragraph 3 

US 5 485 197 A (HOARTY W LEO) 
16 January 1996 
see figure 35 

see column 18, line 63 - column 19, line 
18 



23,26, 

30,43, 

54,59, 

62-64 , 

69-71, 

113 

119 



116 



15 



2,3, 

62-64 

67,68 



C.<Conttnuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ' Citation of document, with indication.where appropriate, of the relevant passages 



Relevant to claim No. 



NYGREN K,. JONSSON I-M, CARLVIK 0: "An 
Agent System For Media On Demand Services" 
PAAM 96, PROCEEDINGS OF THE FIRST 
INTERNATIONAL CONFERENCE ON PRACTICAL 
APPLICATION OF INTELLIGENT AGENTS AND 
MULTI-AGENT TECHNOLOGY, 

22 - 24 April 1996, pages 437-454, 
XP002086093 

see page 440, paragraph 1 - page 441, 
paragraph 5 

see page 443, paragraph 5 
see page 445, paragraph 1-6 

CHEN H ET AL: "INTERNET CATEGORIZATION 
AND SEARCH: A SELF-ORGANIZING APPROACH" 
JOURNAL OF VISUAL COMMUNICATION AND IMAGE 
REPRESENTATION, 

vol. 7, no. 1, March 1996, pages 88-102, 



XP000619822 
see page 89^ 
see page 91. 
2 



left-hand column, paragraph 2 
right-hand column, paragraph 



"WebTV Networks Chooses 
Spyglass'SurfWatch Parental Contois" 
AVAILABLE FROM INTERNET, 10 July 1996, 
XP002086094 

http ://www. spygl ass . com/newsf 1 ash/rel eases 
/96/071096swwebtv . html 
see page 1, paragraph 1 - page 2, 
paragraph 1 

QUINTANA Y: "KNOWLEDGE-BASED INFORMATION 
FILTERING OF FINANCIAL INFORMATION" 
PROCEEDINGS OF THE NATIONAL ONLINE 
MEETING, 13 May 1997, pages 279-285, 
XP002057953 

see page 282, paragraph 4 - page 284, 
paragraph 1 

US 5 410 344 A (GRAVES GORDON T ET AL) 
25 April 1995 

see column 2, line 23 - line 40 

see column 4, line 22 - column 6, line 16 



29,69,71 



23,59,70 



26,43,54 



23,29, 
30,59, 
69,113 



26 



Form PCT/1SA/210 (continuation ot second sheet) (July 1992} 



BNSDOCID: <WO 98561 a8A3_l_> 



page 3 of 3 



INTERNATIONAL SEARCH REPORT 



Intet .jonal appitcatton No. 

PCV/IB 93/00895 



Box I Observations where certain claims were found unsearchable (Continuation of item 1 of first sheet) 



This International Search Report has not been established in respect of certain claims under Article 17(2)(a) for the following reasons: 



I I Claims Nos.: 

because they relate to subject matter not required to be searched by this Authority, namely: 



I I Claims Nos.: 

because they relate to parts of the Intemational Application that do not comply with the prescribed requirements to such 
an extent that no meaningful International Search can be carried out, specifically: 



3. I I Claims Nos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 6.4(a). 

Box II Observations where unity of invention is lacking (Continuation of item 2 of first sheet) 

This International Searching Authority found multiple inventions in this international application, as follows: 

see additional sheet 



^ ■ I X I ^" required additional search fees were timely paid by the applicant, this International Search Report covers all 
' " ' searchable claims. 

2- [ZZI ^" searchable claims could be searched without effort justifying an additional fee, this Authority did not invite payment 
of any additional fee. 



3- As only some of the required additional search fees were timely paid by the applicant, this Intemational Search Report 
' covers only those claims for which fees were paid, specifically claims Nos.: 



4. I I No required additional search fees were timely paid by the applicant. Consequently, this International Search Report is 
restncted to the invention first mentioned in the claims; it is covered by claims Nos.: 



Remark on Protest 



I I The additional search fees were accompanied by the applicant's protest. 
[ X I protest accompanied the payment of additional search fees. 



International Application No. PCT/ IB 98/G0895 

FURTHER INFORMATION CONTINUED FROM PCT/ISA/ 2 IG 

This International Searching Authority found multiple (groups of) 
inventions in this international application, as follows: 

1. Claims: 1-22,24,25,27,28,31-42,44-47,49-53,55-58,60-68, 

72-112,114-119 

Providing an easy to use television based Internet terminal. 

2. Claims: 23,25,43,48,54 

Providing a quality control and a censorship of Web pages. 

3. Claims: 29,30,59,69-71,113 

Providing an intelligent search agent. 



<WO 9856 1 eaA3_t_> 



INTERNAT NAL SEARCH REPORT 

tniormotion on patent family members 



Intern ' ml Application No 

PCT/IB 98/00S95 



Patent document 
cited in searcl^ report 



Publication 
date 



Patent family 
member(s) 



Publication 
date 



WO 9713358 



10-04-1997 



AU 
CA 



7387196 A 
2232003 A 



US 5485197 



16-01-1996 



US 
US 
US 
US 
US 
US 
US 
US 
US 
EP 
JP 
WO 
AU 
AU 
CA 
CN 
CS 
EP 
FI 
XL 
JP 

PT 
TR 
US 
US 



A 
A 



5526034 
5412720 
5220420 A 
5093718 A 
5594507 
5442700 
5557316 
5550578 
5587734 
0638219 



A 
A 
A 
A 
A 
A 

7509817 T 
9322877 A 

643828 B 
8483891 A 
2052477 
1063593 
9102869 
0477786 

914552 
99586 
6022315 



A 
A 
A 
A 
A 
A 
A 



99110 A 

25669 A 

5361091 A 

5319455 A 



28-04-1997 
10-04-1997 



11-06- 

02- 05- 
15-06- 

03- 03- 

14- 01- 

15- 08- 
17-09- 

27- 08- 

24- 12- 
15-02- 
26-10- 

11- 11- 

25- 11- 
02-04- 
29-03- 

12- 08- 

13- 05- 
01-04- 
29-03- 
22-02- 

28- 01- 



1996 
1995 
1993 
1992 
1997 
1995 
1996 
1996 
1996 
1995 
1996 
1993 
1993 
1992 
1992 
1992 
1992 
1992 
1992 
■1998 
•1994 



31-12- 
01-07- 
01-11- 
07-06 



-1993 
-1995 
-1994 
-1993 



US 5410344 



25-04-1995 



NONE 



PCTech/lnternet Tools 



By Brian Proffit 



Intercast Brings the Web to TV 

A new technology may change the way you watch television. 



Some of our younger readers may not 
recall that a computer monitor used 
to be called a CRT, which stands for 
cathode-ray tube. Why should you 
care? Because Intel has taken advantage of 
a property of these tubes — the same kind 
found in televisions — to bring together TV 
and the World Wide Web. 

Originally designed by Intel and now guid- 
ed by the Intercast Industry Group, Intercast 
is a technology that lets Web pages be trans- 
mitted as part of the standard television sig- 
nals from broadcasters and cable networks. 
These aren't the same pages you would see 
on the Internet, though; they're directly relat- 
ed to what is being broadcast at a particular 
time. As Qvc is displaying a product for sale» 
for example, it is also '^Intercasting" a Web 
page that provides more product information, 
such as available sizes or colors (see Figure 1). 

Since this information is sent through a 
cable, no connection to the Internet 
is necessary to view these pages. But 
broadcasters do want to provide the 
variety of hyperlinked pages that 
experienced Web surfers expect. 
In order to do that, they may send 
dozens of different pages, which are 
cached to your disk drive. That need 
for disk space is the biggest reason 
Intercast requires a computer rather 
than a black box on your television 
(although that may change when 
televisions become digital). 

HOW DOES IT WORK? 

Televisions create an image by fir- 
ing a beam of electrons from the 
. back of the picture tube to the coat- 
ing inside the front of the tube. The 
coating and resulting picture (in the 
U.S.) are composed of 480 horizon- 
tal lines. The electron gun paints the screen 
60 times each second (60 Hz), but unlike 
modern computer monitors, televisions in- 
terlace the lines. In other words, the gun 
paints the even rows during one pass and the 
odd rows on the next pass. That's why the 
effective rate of televisions is only 30 frames 
per second (fps). 

When the electron gun reaches the bottom 
of the lube, it takes a certain period of time for 



it to be deflected back to the top of the tube. 
That period is called the Vertical Blanking 
Interval (VBI). During that time, the pic- 
ture tube can't be displaying any additional 
information, but the broadcaster continues to 
transmit a signal. To allow for this timing dif- 
ference, television transmitters actually send 
525 lines of information for each frame — 
262.5 lines, 60 times each second. (Yes, half- 
lines are sent. Did you ever notice a single dot 
in the middle of your TV at the top and bot- 
tom of the picture? That*s an artifact of the 
half-line transmission.) 

Television transmitters, therefore, are 
sending 45 lines of information, 30 times each 
second, that arent being used for displaying a 
picture. If you adjust the horizontal hold of 
your television so that it starts drifting up, 
you'll notice a black area that separates sec- 
tions of the picture. That's the VBI. For some 
time now. Closed Captioning text for the 




FIGURE 1: While viewing the live show in a TV window, addiiional 
information is displayed in Web pages below. 

hearing impaired has been sent in the VBI. 
That limited bit of text, though, takes only one 
line of the VBI. 

Broadcasters use other parts of the VBI to 
commurucate with local stations and cable op- 
erators. Did you ever wonder how local com- 
mercials are interspersed so precisely with 
network feeds — particularly during sports 
events, when the moment a commercial wilt 
start is unpredictable? Broadcasters send 



clock signals and commercial-timing informa- 
tion to the local provider through the VBI. 

The format of the VBI is defined by the Na- 
tional Association of Broadcast Transmission 
Standards (NABTS). The content of ten lines 
in the NABTS VBI standard is undefined, and 
this is the area Intercast uses for transmission 
of packets of computer data. Note, though, 
that Intercast has not become part of NABTS. 
In the words of an Intel spokesperson, "Those 
lines are first-come, first-served. That's why 
we were so anxious to get broadcasters using 
this space before somebody else tried to get 
them for something else.'* 

AS FAST AS ISDN CONNECTIONS 

Even with a cable connection, chances are 
good that your picture reception isn't 100- 
percent perfect on all channels. A little shad- 
owing is acceptable for video images, but 
when transmitting data, you need absolute 
accuracy. Over phone lines, there is 
handshaking going on between the 
modems to detect errors and re- 
transmit data as needed. Since the 
signal from TV networks is one-way. 
that isn't an option for Intercast. 

As a result, the Intercast data for- 
mat includes some redundancy and 
forward error-correction techniques 
to ensure that you receive the data 
accurately. With this extra data 
stuffed in, Intercast can pack around 
350 bits into each line. Using ten 
lines that are sent 30 times per sec- 
ond, you see a data rate of around 
100 Kbps — roughly the equivalent 
of ISDN throughput. At this point, 
most broadcasters are using only 
three of those lines, giving an effec- 
tive data rate roughly equivalent to 
that of a 28.8-Kbps modem. 
During testing, I used a Hauppauge Com- 
puter Works WinCastytv card to receive the 
signal. The WinCast card acts as a combina- 
tion tuner/modem. It handles the display of 
the live TV image, and the analog/digital 
conversion of the VBI information. Each 
line of the VBI is viewed as a separate data 
packet, which is passed on to the Intel Inter- 
cast browser, which comes bundled with the 
WinCast card. There, a low-level Intercast 
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decoder extracts the bits, and then the for- 
ward error-correction layer fillers it into a 
decoded datasiream, which is sent lo the 
Intercast viewer. 

A key to the potential success of Intercast 
is that the decoded datastream is in the same 
HTML format you would find on the Web. 
For broadcasters, it means they can create 
Intercast content using the same HTML tools 
they already employ for Web pages. Stan- 
dards for font sizes, colors, positions, em- 
bedded graphics, and hyperlinks are already 
defined. In fact, Intel expects to have Inter- 
cast viewers incorporated with other brows- 
ers, such as Netscape Navigator. The low- 
level data format, though, remains an Intel 
trade secret, and the company doesn't plan 
to expose an open application programming 
interface. That means that only Intel can do 
the work to incorporate Intercast in other 
browsers, 

BACK-CHANNEL HOOKUPS 

Everything I've described so far can be done 
with no connection to the Internet whatso- 
ever. On the other hand, if your computer is 
connected to the Internet, this can become 
an interactive environment. First, Intercast 
Web pages may include hyperlinks to other 
pages that have been downloaded and 
cached in the background. But they may also 

»v v/cil \jtx lil^ TYCU ll^Cii. 

il yuu L-iick on one or inese, your Internet 
connection is made and you surf to that page 
automatically. 

Other options can make it even more inter- 
active; The Intercast Web pages from QVC, 
for example, dont just allow you lo learn 
about an object; they allow you to place an 
order through your back-channel Internet 
service provider. During the Olympics, NBC 
used Intercast to lei viewers be judges during 
the diving competition. Through a separate 
Internet connection, viewers could enter their 
scores for a dive and then see, on their Inter- 



cast Web pages, average viewers' opinions 
next to the judges* scores. 

MORE THAN JUST HTML 

Other types of data besides Web pages can 
also be included in the Intercast datastream. 
One of these additional types is biUboard in- 
formation. For example, CNN broadcasts a 
stock ticker in the VBI (see Figure 2). A fea- 
ture of the Intel Intercast browser allows 
you to define the stock symbols you want to 



A key to the potential 
success of Intercast is 
that the decoded data- 
stream is in the same 
HTML format you 
would find on the Web. 



follow, which are then flashed continually 
in the browser. 

The IIG standard also provides tor trigger 
data to be transmitted. Triggers can automat- 
ically swucn me i v to run screen or even 
change channels. Th&y can also determine 
when cached pages should be pulled up for 
display. This allows broadcasters to begin the 
download of complex pages well in advance 
of the time in the program that relates to the 
page. Then, at just the right moment, the page 
can be pulled from the disk and displayed. 
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SHOULD I BOTHER? 

Performance is mixed. Since it uses the 
DirectDraw API, Hauppauge's video image 
was crystal clear at 30 fps, even in full-screen 
mode. That means you have to use a PCI 
video card with a Direct- 
Draw device driver, but 
the result is a direct trans- 
• fer of data from TV card 
to video card, with almost 
no effect on the workload 
of the Pentium processor 
itself. 

On the other hand, In- 
ters Intercast decoder 
keeps the processor fair- 
ly busy, which is why a 
Pentium is required. One 
member of the IIG consor- 
tium opined that Intel was 
deliberately not making 
the decoder available in 
chip form so that peo- 
ple would receive another 
nudge away from 486 sys- 



tems to Pentiums. Worse, Intel's browser is 
really slow. If you link lo the Internet, be pre- 
pared for pages to take twice as long to load 
as they would with Netscape Navigator. 

Also, programming is still somewhat sparse, 
NBC is using Intercast during NFL football 
games (to transmit information like statistics, 
game summaries, and so on), "Dateline NBc." 
and "Homicide.*' QVC is using it extensive!'. ;o 
enhance the shopping channel. CNN is pro\ id- 
ing regular news updates on Intercast paoes. 
as well as the running the stock ticker. Mrv 
is using it on a limited basis, but its new chan- 
nel, M2: Music Television, will use Intercast 
extensively and plans to include the ability 
to order tickets, plus links lo band pages and 
concert information. 

To be fair, this is just the beginning. The 
browser works fine now, and other broadcast- 
ers are likely to jump aboard as Intercast 
cards and systems begin to sell. NBC uses 
Intercast so "Homicide" viewers can try solv- 
ing crimes before the detectives. The Inter- 
active Crime Lab provides additional clues 
that aren't in the show, providing an experi- 
ence that those without Intercast are missing. 
As soon as ABC, CBS, and Fox feel there is a 
reasonable group of people watching "Homi- 
cide" for just that reason, you can bet they'll 
leap onto the bandwagon. 

In the near future, von will thic riafo_ 
transmi?s«;inn ;»htlitv tic^ri f/^T cthcr thin"'" 
Imagine downloading software from a TV sig- 
nal, or ordering something from The Share- 
ware Channel and having it transmitted to 
your system immediately. And imagine the 
marketing agreements; Watch "Star Trek: 
Voyager" and receive a free upgrade to Lotus 
Word Pro in the background. 



HOW DO I GET STARTED? 

Right now, there are two ways to begin using 
Intercast. If you already have a Pentium PCI 
system, you can plug in Hauppauge's Win- 
Cast /TV card for about $99. If youVe plan- 
ning to buy a new system, you might want to 
consider an AST Advantage! Communica- 
tions PC, which now comes with Intercast abil- 
ity built in. Quantex is also offering systems 
with Intercast built in, and Gateway 2000, 
IBM, Packard Bell, and Sony have announced 
they will be shipping Intercast-capable sys- 
tems in the near future. 

Be aware, though, that some locations 
can*t receive the Intercast signal. A few cable 
companies use the VBI for other things, such 
as diagnostics. This is rare, but check with 
your local cable company to be safe. You can 
also check IIG^s Web site, www.iniercast.org, 
for more information, including the names of 
cable companies that pass the VBI through 
untouched. □ 
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